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ABSTRACT 

The study of problems in State planning for 
vocational education i^urveyed the vocational education directors in 
the various States and the District of Columbia to determ^ine what 
were their major planning problems. The survey instrument consisted 
of three sections: time spent on planning (both in general and an the 
State Pl^n for vocational education) , problems in vocational 
education planning, and identification of critical planning problems. 
It was administered to State directors in January 1973, and 33 
useable questionnaires were completed. From the survey o.f time 
allocated to planning^ the data indicate that overall State planning 
constitutes on the average about 20% of the total man-months 
available for all/pur poses, while State Plan developing takes only 
about five percent of' available time. In. addition, two distinct 
measures indicate that the most pressing problem facing State 
'>directors was the uncertainty of the availability of future fiscal 
. r^jsources. Clustering the States according to similarity, of responses 
suggests that, holding percent'a^ of total time spejit on planning 
constant, those States which devo-te the least of their planning* time « 
t;0 the Statje Plan and iijore time to State planning in general have the 
least severe ' planning problems. The lO-page survey \instrume-nt 
qomprises an appendix. (AutHor/JR) 
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• ^ • , / PREFACE . * * * 

The^ DASP Program Division of the Center for Occupational Education 
is commicced to assisting vocational education decision-makers in the 
Identif icacion, collection and use of policy-relevant inrormation for 
planning. Consistent with our effort to seek participatory input from 
those act4ially involved m the daily administration of- vocational 
education in the field, this national survey presents aa analysis 
•^specifically ^f problems encountered in planning by state directors.' 
The amount of time spent m 'State Plan preparation is compared with 
th^t ^pent on state planning in general. Problems consistently ranked* 
hig| in priority for solutioh'^ware isolated. The , responses to this - 
survey suggest that there is a general consensus on the single most 
important problem facing state directors in vocational education.. 

The assistance of the American Vocational Association was in- 
valuable in this study,. • In particular we appreciate the help of 
Mr. Lowell A. Burkett and Mr. Dean Griffin in thp design of instru- 
mentation and review of the final report | and Mrs. Chris Berger in 
the disseminartion of the survey. \ 

Donald W. Drewes, >Director 
DASP Program Division 
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INTRODUCTION ^ * 

Rec?»nt x'ederal legislation in vocational education has focused 
cojisidc^rab 1? attention on state planning and particularly the Stat?* 
Plan. Yet Arnold (1969) consWerpd the conduct of statewide program 
planning, in vocational education to have^^,een "at ' best ^somewtiat haphaz- 
ard and fragmentary" (p. 5). He cited a number of reasons; for this, 
among whf>fh' are- lack of funds e:::clasively for planning, lack of data on ■ 
labor, loark-et net^rds, "and a lack of initiation or leadership J.n planning, 
from the state level. , 

The most obvious- and tangible' product of the federal mandate to 
vocattoqal education is- the State Plan. It is impqrtatit, though; to' 
.distinguish between the'State Plan, required by federal legislation 
since" 1917 and given additional emphasis in the 1963 Vocational Educa- 
tiorrAct and 1968 Amendments, and state planning . While state planning 
clearly i.ncludes the^ St*ce Plan, "it tis easier to define the second -than 
the 'first, Thu^y in<-n;aking interstate comparisons, it is somewhat 
easier to 'do so in'terW.of the'State Plan, because of thjB relatively 
homogen^Q's response to rigorous federal' guidel ines for its construction. 
There .is, however, evidence that the' "document is largely engineered " 
JLowatd comp'liance aijd^is not of ten' used, operationally (Lawrence ^nd Dane,, 
19'/^)% j Reasons for .this have freqqent'ly been sought In the extreme ' 
specificity ot controlling 'legislation (Thompson:, 1973). The National 
Advisory. Cauncil, in its fourth report ( 197 1) cons idered ^the speCi'fica- 
t,ibns^"s'o meticulously detailed . ^ . [that] annual preparation becomes . 
a chore tor the expert in grantsmar^ship,"" .However, so little attention 
ispa^d to the plan at' the regional or federal level that' "its review 
in^ the Of.fice of Education has *Hterally been entrusted to secretaries" 

\ '-' ' Suspicion about the quality of data available to state* vocational 
education p^a^ners h^s"" led to further .distijust of %he accuracy of pro- 
-jection.i, contained as jusjf if Ications for program choice in State Plans 
(lawVence and Dane, 1'974, p, 69). A careful, *iri-depth Itudy of the^ 1970 
Ai^b'kma State Plan by the' State Advisory touncil revealed "gross inade- 
quacies 'in planning and in , methods of determining stat-e Aeeds" (Alabama' 
State' Advisory Council Report, 1970). Tha North Carolina State Advisory 
Council fdr Vocational Education recohunended 'in it^s 1970 report that / 
Either the State Plan be organized so as -to display goals, .objectives, 
and pribxities in an interrelated fashion, or the State agency do so in 
a separate document. Dissatisfaction by- state adviS9ry councils with 
State Plans is, therefore, reflected, in' the conclusion by the National 
Advisory 'Council that the State- Plan is not ^a viable planning instrument'. 

,It is not clear why little research has been 'generated m such an 
important ar»ia so obviously in need of objective'examination. K^egarding 
the State Plan, one study has found, rather than the restrictive nature"* 
of federal .guidel ines , that "ineffective leadership ^t the state level" 
may be,-^to blama fo^-^he weaknesses that exis.t! (Vandiver, 1968, p. U23^), 
Another s'tud> , however, has pointed to an inher^rit anconsiscencv in 



existing I'.gislntion The \9h\ Vocational Education Act and '1968 
Amendments c-mphasized tht desmvition of rht Stat'. Board as the sole 
agency for the jdniinis-trat ;op and supfrvlsLon of local \^acat IoimI' cdu- * 
cation supported by federal funds Vrt th^ inti'nt of the 1968 Aoiend- 
nents, vith Che incrodactiop of the submission ot iocaJ plans, seems to 
require that planning reiipons ibi i i c be shared between state and local 
agencita The- airbigait> ot this r^: lat ionshi p afid its implications con- 
cerning the dichotomy betu'cen the p 1 aiming^ a-^d delivery functions of 
vocational t-ducation were dis»:us?cd in Wojdruff aj. (197^), They ^ 
suggested t xpans ion, of . thf role of the state ag-ncy jji the planning 
process and indicated a need for c la: if ica: ion of the state agencies* 
respoAsibi 1 icy for the planning process. 

There is verv little documentation regdrding tiic specifics of 
the stat^ planning process as distinct from t imf. "-^pent in compliance 
with feaeral requirements. One line of research has focused on the 
necessity for coordination of expertise ar the S^tate level (Nowrasteh, 
1971, Arnold, 1969, loomis, 1969^> Other studies have focused on both 
the qualifications and informational inputs required for vocational edu- 
cation agencies personnel at the state level Gray (1970) identified 
147 competencies required for state- personnel .in the areas .of socio- 
economic, program and rcsoutce planning. InformajLion needs of state 
directors were categorized by McCracken (1973). However, there is an 
absence of research to drterm?.-nc empirically, at the state agency level, 
what » pi anning personnel perceive as being the problems that directly 
obst ruct effective planning. 

Taking the operational view of planning, the study, documented in 
this report addressed the above ^def ici ency by contacting directors in 
the state.s and the District of Columbia to determine first-hand what 
they saw as being their major plann ing-^re lated^prob 1 ems . It was, there- 
fore,' the purpose of this exploratory study to determine (1) if problems 
which have b^en identified in tht literature an<^ froR other sources. are 
consistent across states, and (2) if clusters of planning problefjis could 
be derived which were of operational significance for research purposes. 
More spec i i ical ly , the objectives were ' . 

1 To assess the sever ity , iLLiVfclllii. occurrence and signif i- 
c ance of problems as pe rc<^ iveoL by state 'directors of voca- 
t iona 1 educat ion, \ 

2. tb determine the amount of t i me ^a 1 Iol ated to p/anning within 
the state depar tment s ; 

to determine the problems as perceived bv , sr^t e - 1 eve 1 plan- 
ne-TS as most frequent and sevr.r^ or ''*mo<^t significant*'; 

to determine v/hethtr meaningful clusters of probl^ems could 
be developed for future research and intervention purpos--*s; 
and / 

to determine if groups of respondents (states) who respc^d 
alike diffe^T in the .amount of time allocated to pl.^nning. 
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METHODOLOGY 



This section' describes ' the development of the survey itistrument *, 
the procedures employed in the survey, and the' data analysis techniques. 

f ' * ./^ 

Survey Instrument Development * ^ _ 

ThQ' suryey instrument used in this study' can be divided into three/ 
section^ (refer^to Appendix A), 'The'first section Is addressed to dete;?^ 
mining (l) the man^months Allocated to planning, (2)'the man-month? 
allocated co the development of the State Plan, and (3) the percentage 
of tocal available man-months spent in planning. The secood sectipn 
1 ists' problems that have been identified fi^om the literature and from 
discussions vith state directors of vocational education/ A f/ve-point 
rating scale was applied to each problem (item). Each item-^ ^i^ated on 
two bases; (1) frequency of occurrence of each problem and (2)^he 
severity of the problem when it occurs. A team of ten judges was involved 
in test ing» the content^ val idity of the instrument, (Four psychometric ians , 
four state-level personnel and two representatives from the American Voca- 
tional Association reviewed the instrument for comprehensiveness and 
redundanc}^. ) The third section deals with the identification of critical 
planning problems. 



Survey Proced'ures 

On January 16, 1973, packets containing a cover letter from LQwell 
Burkett, Executive Secretary of the ;Amer ican Vocational Association,^ an 
addressed and stamped envelope for returning the survey,, and one copy of 
the survey" instrument' were mailed to 49 ^tate directors of vocational 
education,^ who constituted the entire population df interest for this 
study. Thir.ty-seven instruments were returned.- Of these, .33 were usable 
(Complete fprms) and were coded and subsequently analyzed. Three of the • 
responses were unusable because of failure to follow directions, and one 
respondent declLned to complete the form at all.^ 

; . : y . ' ' ' ' 

R^espon^s wer^ coded directly from the purvey instrument,^ and each 
state's^ responses were punched and verified. The data analys.es discusaed 
in the' next st^ction were performed ""on 'an IBM 360 Model 165 CQmputer, 
using Statistical Analysis System (SAS) software. 



On the front page of the survey £orrti the respondent noted'^ that 
"State planning in votational edutcation is handled "very weir in the Bureau 
of Vocational Education, It takes man-hours to plan and we do it," 
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» .Means w^re ;co;nputed on eat>h of "the iftem^ i-n Sections 1 apd 2 of 
the survey, Ifcems in Section ars ,wel,l as states, were' clustered by^ 
Ward's hierarchical clusterings pr^bcedut-a (Anderberg, 1973, p. 42), 
Cleans amd standard 'devi^t ions^ l^ere ^computed tor state clusters^ and for 
item clusters in terms of the produ&t of thfiPraling oo frequency, of 
occurrence and st*verity. Item one, Secti£)n 3) was analyzed by a fre- 
quency count of, s,tate3 ^nentioni^ng a particular item. The reinainder of 
the items in Sect ion- 3; were contenj analyzed. ' ^ ^ ^ 
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' RESULTS AND DISCUSSION ' 

ihe results section pr^esents: (1) time allocated to planning, 
(2) frequency and severity of* identified problem areas, '(3) critical 
planning problems, (4) clus^ter.s of planning problems, and (5) clusters 
of states. ; A 

■ • . ■ 3' 

Tim e AlJocated to Pl anning 

Item 1 asks for the approximate number of man-months allocated 
tp planning- i-n;;tiie organization. The mean number of man-months allo- 
cated no planning each year was 68,75 with a standard deviation of 88.4^. 
Item 2 asks ior the approximate -number of man-months spent on the devel- • 
opment of the State .Plan (riot including local time spent on local 
^ plans). The mean number of man^montihs spent was 18.70 with a standard 
deviation of 44.67. Item 3 request^ the percentage of total available' 
' man-hours spent in planning. The mean percentage was 20 18 with a 

standard deviation of 12.50- 

\ 

, Only 27* percent of the time spent in planning was related to the 

development of^tfhe State Pl^n. This fact tends to supporj^-the contention ' 
of many t.hat the State Plan is merely a compliance document- which does 
iiot.at all represent the true planning capability and ^efjfprt. at the '^tate . 
^ level. Since total planning time is *only 20.18 percent of the total m^o- 
^hotirs available^ it would seem .that approximately five percent of avail-' 
able time is spent on the State Plan. ( 

i It is important, however, to note' the' impl ications of these 
^Calculations. The data suggest that the average state agency spends just 
*one-^ifth of its time, or 68. 75 • man-months , on planning- - implying a total 
number of 341 man-months, on' the average From this, one concludes that 
the- .average state agency for vocational education in the United States 
employs anpualiy the equivalent of 28 full-time personnel, a very low ' ' 
estimatfe. Judging from the, skewed distribution of responses to Section 1 
item 1(0= 88.45), it s^ems likely that the mean is a poor measure of 
central -tendency in this x:ase,'and that most states spend' more time on 
planning than the means indicate. Other possible explanations are either v 
that respondents have generally tended to underestimate time spent on 
'planning, or that the mean as a statistic is more representative of small 
states These conclusions are tentative and require further research. 
However, one conclusion that .seems warranted from these data is that 
though the mean values seem small by absolut*^ standards, the relative ' ' 
difference between time spent on state plans and on p'lanning in general 



0 * ' 

' One estimate (Hice, ^968, p. 35) projects 1965 regional .state 
, agency professional personn^j to 1970 The mean 1970 projection for a 
"sample" state division of^ocational education across the nine regions 
s IS 168, and the range, got Strom 31 to 468. 
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is large. If we assume that though the escicnates are low— for reasons 
given above regarding implications for numbers of -agency pe^^-spnnel —r 
'they are likel\ to ba uniformly low within states (and by roughly similar 
amounts) » 'then the important and ^legit imate conclusion is that state 
agencies spend on the average one -quarter .of the time o' their State Plan 
tli-t they spi-nd on scate ulanrLn- in general. 



Frequency, and Sever ity of Probiem Areas 

Table I presents the mean rating, on^.a fiv.e-point scale, of the' 
frequency of occurrence i,0>, severity of th^ problem (S), and a composite 
-single measure, the product of frequency times occurrence (0 x S) for 
each of the 56 items in Section 2. The 12 most frequent and severe prob- 
lems as measured by (Ox S), in order of their magnitude, are. 

a the uncertainty in'avallabi lity of future fiscal .resource for 
programs (Item 38); . 

b. the insufficiency of f iscalN;esources available tov^upport 
long-range programs '(Item 39))^ ) 

c. t;he inadequacy of systems to me^ure the benefits of voca- 
tioital programs (Item 48); 

d. the difference in formats ^f data collection across ageocies 
.(Item 17); . . ... 

~. e^. -i^he inadequacy of procedures for the estimation of future - 
^ empioymen^^demands (Item 54); ' . .] 

f . the lack of training in planning techniques of locaV*level . 
staff (Item 36) ; ^' - , . 

^ g. the ,laok of adequafte personnel to prfocess and aijialyze data 
. (Item 31>r / . / ^ ' ' ' 

h. the inadec^uacy of presently availafb'le data for planning 
' purposes (It^ 15); . ' ' * : ' • 

i. the inadequacy of student foltow-up dstta (Item 49 )f; 

/ j. the ina<fequacy .jof;^.j[jijor<matiot\ conperni^tig societal need^s for ^ 
vioc^^ional e'ducad^cTi";' (Item lOy]. ^ ' ^ . 

.t]ja, incomplete .natareA tj^E'^nf^jiation or> character i^t iqs* of ■ 
^arg^^t popula^iOhg^ {i^^i «Sf ).;"-, arid' /t ' ^ ' ' - 



1 the incomplete nature p;$, fnf prmat ion about> 4eedc of tar^^t^ 
populations (Item 5) • ' 



Table 1 



Mean Rating of Frequencies of Occurrence, Severity of Problems, 
and the Product of Frequency and Severity of the 56 Panning* 
Problems, with Rank Ordering of Twelve Itema Ranked Highest 
on (0 X- S) Rating ^ • - . 



Item . 
Number 



Frequency 
of Occurrence 

(0). 



Severity of 
Problem 



^Rartk Order 
of Twelve 





1 


2 .88 






• " 3.30 




3 


3 .06 




4 


3.49 




5 


2.90 




6 
•< 

7 


3 .58 
3.03. 




8 


3.76 




9 


3,76 




1.0 


3.SI' 


■\ 


^li 


, 3.12 






' 2.61 




14 


2.88 




' - 3*21 




15 


3. 79 




lo 


3 .33 




17 


4, 18 






3 .24 




19 


3 . 76 




20 


2. 76 




21 


3.51 




22 


3.51 




23 


3.42 




24 


3.49 




25 


. 3.21 




^ *26 


3.45> 




• 2;^ 


3.33 




' ' 28^ ^ 


3., 39 




29 ' 


3.09 




^ 30 


2 . 97-^ 




31 


4.06 




32 ^ 


3.51 




33 


3.30 




34 


- 3.-79. 




3^/ , 


.3.58 




36 


. . ^.09 




37 ^ , • 


3.15 




38 ' ' 


4.36 




39 


4.39 



(S) 




0 


X S 


Highest 
r Rat in 


3.06 




8 


.81 




3 .03 




10.0T5 




2.73 




8.34 




3 .09 


^ 


10 


.7.6 




2.82 




8 


.19 . 




3 .39 




L2 


.13 




2.88 




:8 


.7,2- , 




3.58 




' L3 


.43 


12 


3.58 . 




13 


.43 ■ 


■ 11 


3 .55 




13 


.53 


10 


3 . 00 




^..36 




2.67 




6 


.94 




/>p5 




'7 


.32 




2 .82 




' 9 


.04 




3.73 




14 


.11. 


8 






10 


.90 




3 .79 




15 


.83 




2 .97 




9' 


.62 




3.21 




12 


;06 




2 . 79 




7 


68 




3.21 




11 


28 




3.21. 




10 


64 




J . 24 ^ 




11. 


09 




J . J J 




11. 


61 




2.82 




9. 


04 '~ 




3 .09 




10. 


67 




2.97 




9. 


89 




2.94 




9. 


97 


V 


2.64. 




8. 


14 


2; 58* 
3.64 




7. 
14. 


64 
77 


7 


3.18 


11. 


18 




2.85 




9.40 




3.39 




12. 


85 




3.30 




11. 


81 




3.67' ■ 




14. 


99 


> 6 


2.90 


9. 


16 




4.48 




19. 


56 


1 


'4.21 




18. 


50 


2 
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Table' 1. (continued) 



Item 


■ Frequen&y 


Severity of ' 




. Rank Order ' 


Number 


of Occurrence 


Problem 




• of Twelve •■ 


* 




(S) 


0 X S 


Highes^t 0 X ^ 




• 






Ratings , • . 

' • ■ 


■ • 

AO • 


^ 2.85 


• 

- - 2.51 


. 7.16 






2.39. 


2.39 


, 5.72 




42 ' 


'3^..2l 


2,94 \ 


'9.44' • 




ky 


5/15 • 


2.90. 


\ 9.16 


> 




3.42 


3.03 


V 1(^*37 ^ ' 




^5 . 


3.70 


.3.55 


13.10- 






3.49 • 


• 3'. 06 


10.66 ■, 




4 7 


3.,12 . 


2 82 


8.79 




48 


4112 
yV76 


•3.91- 


16' 11 • 


3 . • ; ' 


49 • . 


3 . 64 


13.66 


9 


50 . • 


3.49 


3.12 


10.87' 


V 


51 


3.42 


3.06 


■ 10,47 


* ; . 


52 . 


•3.42 


3.21 


10.99 




53 


3.24 


3.00 " 


9.72 




54 I ' 


4.00' 


3.88 , 


15.51 


. 5 " 


55 


3.64" 


. 3.63 


• 12.22/ 




56 


\ '3.76 


3.49 


13.09 





Si.R^ if leant Planning Problems 



' In Section 3, respondents we're asked to select from Section 2 
those Items^ expressing problems they felt to be '"most significant" for 
p'l^nning in thdir state. Table 2 presents a frequency count of items 
thus chosen. Figure 1 clusters graphically the 16 items with the highest^^ 
frequency of response into eight ordinal categories. This mea'sure of 
criticality of problem areas gives a s 1 iglit ly' different picture from our ^ 
previous' measure (0 x S). 



"By this \neasure, the uncertainty Ln availabilijty of, future fiscal 
resources for p.roblems (Item 38) was considered "most significant" by 
most respondents, corroborating the previous, findl'ng. Poor procedures 
for estimating future employment demands (Item 54) was the next mo&t 
frequent, response in tiiis section; this item ranke^d fifth in the (0 x S) 
measure.' Items 39, 15 and 48, concerning f iscaT "resources for long- 
range^ "programs » inadequate data presently available^for planning, and , 
inadequate measurement of the benefits of vocational education, ranked 
equally as the ,most frequent response^ The^se three items ranked second, 
eighth, and third, respectively, on fche (0 x S) measure. Items 8 and 
17, concerning lack of information or needs^of target populations apd 
different data formats across collection agencies, were the fourth and 



ERJC 



Frequency of Identification of Specific Items as "Most 
Significant Planning Problems in Your State" 



) 

Item Number 



, Nutnber "of Responses 



1 

2' 

• * 3 

4 

• 5 

6 
7 
8 
9 
10 
11 
12 
' l3 
14 
' 15. 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
• .26 

• 27 
28 

30 
31 
3.2' 
33 
34 
. 35 
36 
37 
' 38 

40 

41 

42 - 
-43 
• 44 



2 
5 
1 
4 
1 
5 
4 
12 

'6 

2 

4> 

2 

1 

14*, 

7 ^ 
11 

3 

7 

0 

4 

4 
•3 
' 8 
■ 4^ 

5 
7 
0 

1# 

9 
8 

5 

8 
9 

.10 . 
4 

16, 
14 

l' 

1 

' 2 
1 
6 



1 



Table 2, (continued) 
J 



It ecu Number 



Number of Response 



-I. . 



45 

46 

47 

48 

49 

50' 

51 

52 

53 

54 

55 

56 



9 
5 
5 

14 
9 
2 
2 
4 
1 

• 15 
\6 
6 



11 
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fifth mosc frequently chosen items in"this sect ion ;: these item^s ranked 
twcjlfrb and f.-^urth, respectively, on the (Q v. S) measurt^. Ite.m 36, 
concerning the lack of plannin-g training for i oca 1 - level^ 'staf ranjce^d 
• sixth m frequency on this measure, where it als,o rartked *'on tTO (JO x S) 
rating Items, 31 and**^9, concerniiTg tlie lack of ad'e,quate. [;ef SQnnel 't^o 
process data and the inadequacy of student fol low-Up data^ ranked 
seventh in frequency on this naeasure,, Whereas 'they ^ranked seventh and 
ninth on ;Ehe ('0 x S) measure, rt-.spectlvely . Item:^ 35, ^nd" 45 also ranked 
seventh on this measur^\ though they did no^t' r^nk^in the h,ighe^ 12 gn 
the (Ox S) measure. Finally, Item 9 ranked eighty on this ^measute* 
, with Items 24, 32 and 54. Only Item 9, concerning incompleteness of 
information on targe^t population needs, -was rank-ed in the first 12 on 
the (0 \ S) m.easur^;* it ranked eleventh. , j 

. ft 

Comparing thcae '<:wo measures Tab le 3), it is cj^lear that Item 
38^ which ranks highest on hot h ^measures , is the most important problem 
defined by-tjnis study. Using Kendall's tau (Hays, 1963, p 652) as* a 
test of cbncardance in the rankings of Items 38, 39, 48,-. 17, '54, 36, 31, 
15y 49, 9 and 8-^ on both measures, it appears that there is ,a signifi- 
cant degree of agreement between rankings on these items. (For i * 
' .548, the test for significance provided a z of 2. 331,. which supports 
the hypothesis that x is significantly different ^rom zero a^ be,tter 
than th,e .05 level.) It is, therefore, suggested that these Hi items, are 
reprj^sentat 1 ve of key problems in frequency and severity and in priority 
for solution in the state agencies sampled. * j - " 



Only two problems were not deemed "most stgniftcant" by" any 
state — Items 20^ and 29, concerning restricted access tcjt dajta sources and 
inappropriate choice of data levels. All other items were -ident if ied 
byat leayt one state director as being "most significant." This find- 
ing 1-endp aome support to the contept validity of the* instrument . ' 



5 - 

Clusters of State P^nning Problems Jj^ 

Ward^'s hierarthical clubLer analysis (Anderberg, 1973^ P- 42) was 
chosen as the method for grouping both respondents (states) and problems 
(items), using* 0 x S as the elements of Ithc -mat r ix . This procedure forms 
hierarchical clusters having mirlimum wit nin-^grou^ variation and maximum 
between-group v^ariation at each stage of the grouping process. ' 

Initially, each of the N pre/files can be thought of as groups 
or clusters, each having one* member. The Osgood and Suci measure of 
distance (simply t'he sum of the squared differences ^between the raw ele- 
ments) is used to choose cne two ^groups, most nearly alike. The two are 
oombined leaving N-1 group\^Tm.s^ process continues until only, one' 
group is left (i.e., all proTi l^s 'are clustered into one gr-eup). At 



Item 10 appeared iOth'on the (0 x S) measure but was not ranked 
high in the second measure, so it was discarded from this test^ 
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Table f. Comparisons of Rank (Jrdexing of Iterus by First Measure 
^ (0 X S) and Second Measure (Frequency of Identification, 
• ' ^s "Most Significant" Planning Piroblems) 



'>>4^nk 
Ord^r 



<0 X S) 
Table 1 



Fr^fequency 
Table 2 . 



1 


• 38 


38 

* 






« 

2 . . 


39 . 


' 54 








48 


-39 


15 


48 


4 . 


17 


8 






5 


54 


17 






6 ' , , 


36 


36 






7 


' . 31 


31, 


35, 


45, 


. 8 


15 ^ 


9, 


24, 


32, 


9 


49 , o 


/ 






10 


10 




s 




11 - 
12 


8 
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> i 
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eath stage of the clustering process, the total withip errdr and the.j * . 
change in error are comput'ed. The relative change in' error is used co , 
determine with Tiinimum subjectivity the point at which the homogeneifty / 
of the groups' starts to break down. ; * . ? 

Grouping by item was thus performed. The plot oi within-gf-pup' 
error vs-, groups remaining served as the basis for determin^-ng the^ opti- 
mal number of clusters. 'After five groups were remaining to be clustered, 
within-group error rose sharply, indicating a cluster, solution, 

Table 4 presents the* ntean and standard deviations for each of the 
five obtained clusters. ' > 



Table 4. . Cluster 'Analys is of Problems in State-Level Planning' 



Group- Items Mean (0 k S) ^ S.D. (0 x S) 



I 1, 2, 4, 6, 10, 16, 18, 19, * 10.51 1.36' 

2 1, 22/ 2*5, 26, .27, 28, 37, ' 
42, 45, 46, A7, 5,3 

II 3, 5, 7, 12, 13, 14, 20, 29, • 7.77 ' '• .95 

30, 41 ■ . \ . ■ 

'ill 8, 9, 15, 17, '38, 39. 48-; 49-,' 15.58' . 2?23, 

54 • . _ ' •; 

IV 11, 23, 24,. 33, 40, 43, 44, 10.24 1-40 

50, 51, -52, 55 ^ ' ■ > 

V 31, 32, 34, 35, -3^, 56 13.11 • 1.53 



The items, grouped as in ^able 4, are as follows: 

Group I ' , f * ' 

' ' • . * 

Item 1. The goals of vocational education at th^ state jevel have ^ 
not be^n clearly stated. ^' 

Item 2. It is dlffix:ult to translate state vocational programs to 
me^^trraWL^ product object ives . 

' Item 4 There are difficulties in establ ishipg the linkages be- 
tween product objectives and process necessary to obtain these object iv^. 



• - ^ * • ^ -15 

Item 6. There are conflicts between -the. goals of vocat?ional edu- 
cation and general education. . ' '\ '/ . " 

, ^' ' ' , 

Item 10. InforWtion i3 incomplete"' concerning societal needs for 
vocational education. * - 

Item 16. The necessary data are too costly to coll'^t. ^ ♦ 

Item 18. Available data are collected on inappropriate pqpCila- 
tior(§. , . • X \ ' . ' 

. ltem'19. Collected data quickly become outdated. ^ 

i 

Item 21. Available data do not exist at an apprqpriate level of 
aggregation. , a 



XT Item 22, Reports based on cQliecte'd data .are not updat'ed with 

, sufficient' frequency. ' ' , • 

item 25.'' Data about available physical resources are incomplete. 

It^em 26.* Data about ^av^ilab le human resources are incomplete. 

Item 27. Instruments are not available ^fo? the collection of 
data. * ' . * • 

Item 28. "The form of data is inappropriate for. storage retrieval 
and analysis for reporting requirements. ^ 

; ; 'Item 37.^ Poetical constVairits inhibit effective data-based 
planning.*^ y ^ >fe 

Item 42. , There is no adequate mechanism for determining the 
number of educational^ prof ess ibnals needed in the future/ 

Item ,45. Feedback ^ -tHe degree of attainment of product objec- 
tives is inadequate. ' ^ i^. 

'** f*t ^ 

.Item 46. Feedback on the degree of^>^ttainment Jf process objec- 
tives is inadequate. 

• » 

item 47, Accounting systems to mc nitor expenditures by pro-am 
category are ' inadequate . ' ^ 



dequate for program require- 



Item 53. Local facilities are' inc 
qents. ' . 

Group II ' 

Item 3. It IS difficult to translate state vocational programs 
to observable process objectives. 
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L t i-p 3 . 



Inn-re are conflicts between' state •and lo^al ^;.v-il3 for 



, . f 

Jtem 7, Thci needs of target -populations hav*.^ not bton adequately 
fef .itictcd by i^ta^:c program goals. 

Iter; !J. There is uncertainty at the state levci about the uuf- 
pose of stacc' planning for vocational education. 

' Tc'." l< Tne users of planning informat-ion are moc clearly 
defined, 

I ten l-r. The level of aggregation of information for oarticular 
users 1'^ •loi cleacly de^fine'd. 

rt,(.:n^ 20. Th-ire is restricted access to data sources. 

i>"om 29. jThe choice of level of analysis is inappropr iar r , 

It 30. Choice of method of data analysis is inapprui^r iate . 

Icem-fi. There ig little assurance that funds allocated co the 
iodal schools will be used according to state-level intention.-;. 

Group ill 

Item 8. Information about the needs of target populations is • 
incompje . 

Inom 9 InfQrmation is incomplete concerning the characteristics 
of target populations. 

* » 

itern 1^. The presetitly available data are inadequate for planning 
purposes , 

Item 17. Data collected have different formats acrost>» col lection 
agencies. ^ 

Itom 38. Fiscal .resources that will be available in the future 
to support programs are uncertain or unspecified. 

'A ' . * 

Item 39 Fiscal resources avaiflMble to support long-rapge oro- 
grams are insufficient. ' ° . * . 

ireir 68. Systems to measure benefits of vpcational education pro- 
grams arc inadequate. ^ \ 

I * f K ' 

Item 'V) , Student follow-up data are » inadequate . 

Item S-^. Procedures for the estimation of future emp I oyrfient 
demands ar*.- inadequate./ , ' 

■ It - ^ 
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Cr-iui->. IV 



Item 11. Target popuIatloF^are inadequa^iely represented in the 
planning process. ^ 

Ttoip 23. Data about available fiscal'^ resources are ^incomplete . 

iLer? 2U. Tre imp,l icat ions of data are not clear for .decision- 
making purposocH. 



Itenfi 33. There ar^ inadequate physical facilities to p^cefss 
and anaivze the desired c^ta. 



t ions . 



Item AO.^ Allocation of funds is biased by political considera- 



Iter? 43. Teacher training institutions 'are not sensifive to the 
needs of the i^tate for trained personnel. 



Item 44, Inservice training for state department personnel is 
nadequate, 

Itenn .5(y> Unsuccessful programs are difficult to Terminate. 



Item 51. Criteria fot selection.*of alternative program strategies 
are not specified. ^"^"""^"-^ * 

lt^=im 52. Policies are inadequate ^on how information will be used 
in decision-making. ' 

Jcem 55. Where 'is insufficient con£rol_ over the placement process. 



Group V 



Item 31.* There is an inadequate niimber of personnel available to 
process and analyze desired datao 

Item 32. Thf.re are inadequately trained personnel ,avai lable to. 
process and analyze desired data. ' ' 

allocated to stat'?-level planning 'are in- 

sufficieat*. < 

• Iteri: 35, State-level staffs are not trained in planning techniques.' 

' Uom 36. Local -level, staffs are not trained in planning technique?. 

Item 56. Coordination of general and .vocational education is in- 
adequate, , ■ , , , ^ 
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Statistically, the'clus^ers are mutually? 'exclus iv u * in teW.s of , 
the va'riarxes in responses generated for the i^t of iioms kuhm the* 

'.cluscer Thus, it was protiable that' a respondent \^ho sa^v oae of ^the^- 
items v/it.hin a\pa'rt icular cluster-as a problem woul-d tend to see t^h^'- 
other L'tems m the cluster^ similarly. Conversely,, if one of the items 
is not seen as' a *pro01em, the remainder of iteniS in the cluster tend- 
not to be also for that respondent. Cluster £onten^r--4^v^^ver . in terms . 
of what items appear to be addressing, does notsaem\i:o ba strict. ly ^ 
exclusive across categories'. ^That is, some items'/that seem^to conde^rn 

^simi^ar clashes of planning problems are lod4^d in different categorfes ' 
(e.g. / itemj? 8 and lO). Careful, .though gudfgJienta 1 , copfs iderat ion , . 
nevertheless, of the item ^content within clusters/ h^s yieldecl e^'idence 
of sonie homogeneity, enabling 'the tentative ^tiVi^ng. of c lu^ttrs^ accord* 
ing to general content class. Group I contains items predominantly/^ 
concerned u'ith procedural constraints surrounding the p^lanniug prp<^s " 
in J:h(? areas of goal^expression, data collectioji procedures and f^d- 
back.. Thir> gnoup is, therefore, called the procedure 1/ contextual Vlus-. 
ter. Group II spears to be primarily concerned with the^ends t^oward 
which the planning ^process is diredted: goals, obje^tivps 'and user 
groups Orbup II is thus nam^d the directional cluster,' The third 
cluster dea^s w>ith the problems surrounding the planners* need f^or in- 
formation and is called the informational cluster, Grouf IV concerns 
specific and substantive operatioaal problems, though covering a wide 
range. This is the least 'homogeneous of the categbrie-s and 'is; cal led 
the op6rati.onalv^substant ive " cluster'^ Group V mostly 'contains items 
that address the quality and quaptitv o-f resources, particularly trained 
personnel available for planning tasks in, state ^agencies , and is thu^- ^ ^ 
if^called the ' resources cluster ' ' v ^ 

By examining Dhe mean of means for the item ratings associated 
with problem areas, it was determine that state directors felt that 
ihfoATmational and resource problems * werje the most significant. 

/The' third, or informational , 'cluster contains nine out of the 
11 items on-which concordance .i/as found to be > stati*stic3 1 ly significant, 
which , shows that respondentia tended to respond in the same manner^ to 
most of those items (resulting in low within-item v-ariance across fesp'qnd 
erits). One suggested explanation for the salience of these items, Voth • 
in rank order of frequency/severity .and in "significance , " is that they 
tend to specify problems over which .the respondents may perceive them-, 

, selves as having 'little control. The othej? twp items .Highl> ranked by 
'the earlier' measures are in GtoCip V,^ the resource cluster. • It can be 
hypothesized, therefore, that state directors * key problems seem to 
center around* the shortage ^of necessary* information and resources with 

'which to plan, and that these probTejnds *may be characterized* by a per-- 
caption of their solution'as largely exogenous to'the 'State agency , 
itself . This explanation is tentative and 'take's the form of a hypothesis 
for fut-ure research rather chan a stfon^ly documented empirical cpn- 
elusion. It is, however, supported somewhat by the observation that 
two of the other three clusters which did not figure as importantly" in*.' ■ 

• identif icaV ioa of problem areas (Groups II and IV) are characterized by 



\ 



ag^,rcy qjrcnio-. a-a ^e*-.;/ or-racion, r-?p,--iv*:'ly . iff is r-ascnable 
to d-'-picb -^^^}' of t»— 'c^. c.>r»>:.uual prohlom areas as. to.scmr t-xtont, 
within th.v jur isdiv: io^, and, charcforo, control of the stat'i^ireotor 
ap{},^thu.s, Lo pnc.^iv.-- *->-.on^ <?s l&ss prchL^m^ciCdl , The rera i./ang clus.-* 
ter (Gr Mjp 1 ) , ' hovj-^ver , i^: largely oo-.c-xtaal aac, thsrefo^e, r^xog'vnous; 
yet It dp';'s ret coot.aiP a^y of rbr- particularly saliert probUms. It is, 
the l^r^-ft 'M-js-:-:i a-^-:! Cecils i-no some qaccition rbc» *'3f orf.in.-^rc i or«d con- 

\ . 
\ • 

Cius'.^rs of Scaiis . . ' 

_ *r ^ 

Th-: hi'^rarchical crQccdarc-s vnro applied to scat ss'a] ^-.o . The 
purpo?r her^ was no decerning, it Ihe states' tendency to respond alike 
has any r^'Istionshjr to th^^^' x'^x% sper-r to plannL-i^. Thrfet' state clusters, 
^.'orc d:;rivou (Sc-e Tabit 5.) '"^ 

a. Grou'p L, vho^e oiear 0* x S.v/as 6.9t, spent 71 niar- months 'in 
planrting. 6.3 naarr-mcntb? in Stat*-^ Plan developm'^nt , and 16 
CJ^-rct^iPt of total ava'i ]ab] e ,t ini«- in piarning. 

b. Group II. i7ho5e mean 0 x S was 11, iS, spent A8.5 man-months « 
•in planning totally, 13 .8 .man-monrhs in State Plan develop- 
ment, and 25,9 percent of. the. total available time in^blan- 

, niPg.. . ^ . ■ 

c. Group III, whose mean 0 x S was 1^.6^, speW 65 mar-months 
in planniPgs 34 man-months in State Plan dA^elo^meoc , and / 
13 perr»int of their ava^ilable time in- plann^g. * ' ^ 

The high (Group HI) and low ..(Group I) rating 8rDup3-t5f^ states , 
as rated'^by 0 k S ar^d time spent oa State Pl^n development, spent 
approximately th'? same man- months iii planning and approximately the same 
perc.e.atage of time. Howe/'^r, .t;he hi.4^ rating s^tates (Group III) spfint 
almost 5.2 perrcnt of their total .available time on State Plan develop- ' 
ment, while the low rating :^taris (Group I) spent; only 8.87 percent of 
their available planning time Stata Plan development. Group ITT, 
evidently small «tat<?^., perceive a mod-rate level of planning problems. 

The orly partem -t^m^TglVig frotn chio finding relates to 'the amount ' 
.of time <=ipent in Stare Plan development versus other types of planning. ^ 
An Ifispec-tion ^of the dal.a reveals that eh? ^^tates with che lowest 0 x S 
spent the leas^t t i^^ in-Staco Plar development and, the>.igb:st time in 
viDVi^rall pranp.ing.-^.Convvr^ely, th.- states with the highest 0 x S re- 
portcd.the greatest ^apounr of tim^i spent in-Si;ate Plar development. It 
v?ould hCt^c.mf.tm^-t^D iT-f-r from this that states which oprnd more time ' 
^ ^ , on^compli =»>aV p]anni,ng (i.e., ?tate, Plan devv-lopment) hax^e mor-e problems; 

' ^ however, the' data do not support a determination .of cause and. effect. It 

may be ^chat tie states rr^.orrjng f-w-c probu-m? { lower D x S> have already 
solvec; many p'jannmg probJ'zm''' ard, as a ror>a,quenc.-, spend less time on. 
" State Plan d-velo;^ment Furthermore arf absolute figure of, for example, 
^ 25 mar-mo'ich. maj' ^present a ?ma]l amount of total tim£ for a largp 
agency, or a larg^amou-V, for a small agsncy - 
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lable 5. 



Me^n 0 X S Rating^, Miu^'ek^ of >lan-lIonth^ Spent in' Planning, 
Number of Man-Monithji"%ent in ^State ^Plan Deyelopiuent , a^Ld. 
Percentage of 'To^i^al;;Availabl6 'Tima^-S in^ Planning foi; 

Three Groups \x5f St^atesr Clustered^-^According to^ Singularity 
in Responses 5;. . / - i ' 



Group 


Mean 
0 x^S 


Mah-Mopths 
. - Spent in 
Planning 


Man-Months 
Spent in 
' StaS;^^/Plan ' 
Development 


Percentage of 
Total Time 
Spent .in ' * 
Planning *' . 




96 


71.0 


6.3 

^ / 


16.. 0% _ *■ 


11 ^ 

« V 


11.18 


48.5 


/ 

' 13 . 8 


?5.97o 


III " 

• ^ '' ' 


14.64 




34.0 


' 13 . 07o 


\; 











i.lf'the data do 'not suggest a cause and 'effect relationship, ho^- 
'ever^^'^they- do demonstrate that a great d?.sparrty exists among states in 
tHe" number of problems faced and that -sqme statesjhave. found -ways of 
overc6ming common planning problems. This, in turn, suggests that 
-individual ^sJtates can tiave considerably control over their own destiny 
Vs^lajin'ers ./ Stateii bluntly> it may^eem that ' individual states_ can 
improve their state planning processes without additional f^edera'l assis 
^fance or intervention. ' i ' 



'3 * \> 



V 



' llV; 



CONCLUSIONS 

'The imporbant findings from this study fall ^ into two general 
categories! those concerning the amount of time spent on planning in 
state vocational education agencies and those concerning the kinds of ' 
planning problems state directors find most ^acutely in need of solution. 
^* \ r 

- From the survey on time allocated to planning, the data indicate 
chat overall state rplanning constitutes apprpximately 20 percent of the 
total man-months ayailable for «11 purposes in the average state agency 
of vocational education. _ State Plan development, on the other hand, 
•takes about five percent'of total available time. Our analysis tends 
'to suggest that these estimates are rather low, for reasons elaborated 
in the results section. The data, however, yield prima facie support 
for the contention voiced in the introduction that state planning and 
Stat,e Plans should be carefully distinguished, The finding that states 
appear to. spend only about one-quarter of their planning time on the 
\ ' ' otate Plan offers some possible reasoris for the National Advisory Coun- 

* \ T • -'^''^ dissatisfaction, also documented in the introduction to this 
* J ^ . paper, , *^ 

^ ^^n the second category of findings, the most pressing problem 
facing s^tate directors, by two distinct measures, was the uncertainty 
,^wy;h\VlVic^' Che availability of future fiscal resources for programs was 
I^^dewed/' 'Also perceived as problems high in both frequency and severity 
v^re.the insufficiency of funds to support long-range programs inade- 
quate systems for prqgram evaluat|'J.on , confusions and inadequacies in 
data format and content, and lack of staff and adequately trained person- 
nel for planwing at -both the statjie and local .levels. 

Of the 12. problem statemeits rating highest in both frequency 
and severity, the first two expressed concern over the uncertainty and 
insufficiency of funds.* The others all stated either dissatisfaction 
v/i;th either shortage of data or |laC:k of trained" staff needed for plan- 
ni^.g.* Cluster analysis permittesd further col laps tng of problem areas 
.mt^o five groupings: 'infbrmatidnal, proSedural/cdntextual, resource, 
<i^:^ectional, and operational substantives*. '?It appeared that the most - 
iAaportant problems center aroun^ deficiefnces in the necessary informa- 
tl|>n data and resources (fiscal: and personnel) with which to carry out 
planning obligations . The find'ings suggest the canclusion tlidL the* two * 
^ important problem groupings tend to contain exogenous issues over which 
state directors perceive themselves as halving little control. One of 
th6 three remaining, and the largest of the. cluster of problems Xpro- ' 
cedural/eontextual), however, pont'ained similarly exogenousvissu^s , 
none of which achieved consensus in designation as highly salient by 
a/iy of our measures. Th^ two other clusters .(directional an<5 Oper^ 
tional/substantive) were both /characterized in problem content b5r^ 
fgency-oriented issues, and again they dVd not include any cHB^^e prob- 
. /lems judged salient by, many states.- I^t i^s tempting, th^rl^re, to 
^conclude that state directors/ diagnose as .r(jost " pre^i^tl^g those 'problems* 
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in areas (\vQr which chey have less control, and as less j^ressmg those 
pifublems thr^. solution of which is perceived to li^ within 'tha jurisdic- 
tion of the agency. The presence of a large cluster of exogenous but 
TTTon-salient prob Lems- dictates that such^ a conclusion should, remain 
tentative. . 

When states were clustered according to sithilaritv in responses, 
a relationship was established between the amount of time ^spent on 
State Plan development and the frequency and severity of prohlSlns 
^ncounter'cu .' States reporting the highest problem rating spept the 
most time in .State Plan development. 'States reporting the lowest prob- 
lem rating not only spent the least 'time in State 'Plan development, but 
th'^ most time in overall state planning. These (lata do not permit more 
than associational conclusions to be>drawn from their interpretation, 
and yield no information on cause and effect. However thay suggest a 
clear hypothesivS for further research: holding por#entage of total 
time spent 'in planning constant, those states v/hich devote the least of 
their planning time to the State Plan*, and more time to state planning ' 
in general, have the least^ severe planning problems. . / 

\ ' ' ' 

Finally, there is nothing emerging from the results of this 

study to refute the National ^Advisory Council's 1970 verdict on the 

State Plan referred to in the introduction to this report. There is, 

rather, some evidence -to support that verdict in that states,^ on th^ 

average, spend comparatively litt le ' t ime -in State,* Plan preparation'., 

Moreover , states who spend, the most time in its preparation also re^uLl 

mo re^* severe *and frequent* problems . ♦ , /, / . 
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, " \ APPENDIX A 



A SURV^^i OF PROBLEMS IN SPATE -LEVEL 
PDVNNING FOR VOCATIOML EDUCATION 



Instruct ionc 



This survey instrument is intended to develop information on the 
occurrence and severity of various problems in planning for vocational 
education at the state level. Each of the items shown represents a 
potential problem for state planners. Please read each item carefully 
and rate the problem accordi^ng to its froquency of occurrence in your 
state and the severity of the problem on the accompanying scale. ' 
Circle the iiumber on th-e scale to indicate your estimate. 



Section ^1 



Before beginning the survey, there are three questions we'would 
like to ask which do not fit the survey format: 

1. A'lpproximately how many man-months are allocated to planning 
, in your organization? 



2* Approximately how many man-months are spent on the B'fevelop- 
ment of tuc State Plan for your- state (not including local 
Lime spent '^n local plans)? 



3* What, percen«tage of total "^.an-hours would you estimate is 

spent on^ the planning function in your state organization • 
(inp.l-uding not only development of the State Plan, but all 
planning functions)? 



* Thank you for your time and your assistance in completing this 
survey/ ♦ ' ' • . 



• 
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Section 2 



1, The goals pi vocational education at the state level have not been, ' 
' clearly stated, ^ , ' 

OCCURRENCE: 1 Nsvar, 2 Rarely, 3 Occasionally, 4 Frequently, 5 Continually 

r 

SEVERITY: 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 



2.. Jt is difficult to translate state vocational programs to measurable 
product objectives. - ]^ 

OCCURRENCE: 1 Never, 2 Rarely, 3 Occas ionafly , 4 Frequently, 5 Continually 

SEVERITY: 1 Inconsequential, 2 Minor, 5 Considerable, 4 Major, 5 Critical 

i '■ 

''3r It is difficult to translate state vocational programs to observable 
'process objectives. ^ 

OCCURRENCE^ I Never, 2 Rarely, 3 Occasionally, 4 Frequently, 5 Continually 
SEVERITY: 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 



4. Tliers are dif f i cult ies in establishing the linkages between product 
objectives and the processes necessary to obtain these objectives. 

OCCURRENCE: 1 Never, 2 Rarely, \ 3 Occa-Kl^aUy , 4 Frequently, 5 Continually 

<SEVER,ITY: 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical ' 



5. There are conflicts between state and local goals for vocational 
, educat ion, 

OCCURRENCE: 1 Never, 2 Rarely, 3 Occasionally, 4' Frequently , 5 Continual] 
SEVERITY;' !• InconsQquential , 2 Minor, 3 Considerable; 4 Major, 5 Critic/ 



6. There are conf I icta -between ^the goals of vocational educatiori and 
general education. 

OCCURRENCE: 1 Never, 2 Rarely, 3 Occasionally, 4 Frequently, 5 Contit/ually 

^ / 

SEVERITY: 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 
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» « * 

V 

7. The needs^ of carget popi/latior.s for vocatiOKal cSu:atIon h'ave riot 
been adequately reflected by st:a^t:»i\prograir« g6j„ls. 

0CCURRE^I5E : Nevar* 2 Rarely, 3 Occasional iv, ;4 Frequf:ntLV, 5 Continually 

SEVERITY: ,i Inco issquerrt ial , 2 Minor, 3 Cortuderabie; 4 Major, 5 Critical 

8. InformacLor 4bc'Ut the needs of carget popalaticrs is incomplete* 
OCCURRENCE: i Never, 2 Rarely, 3 Occasional ly,- - Fr^^quently, 5 Continually , 

• SEVERITY: 1 lacons^quentiai , 2 Minor , 3 Considerable. ^ Major, 5 Critical 



9. Information is incomplete 'concerning ^'be characteristics of target 
*- oopu lations . ^ 

OCCURRENCE; 1 NVver, 2 Rarely, 3 Ocpasionallv, Frequently, 5 Continually 

SEVERITY: 1 Inconsequential, 2 Minor, 3 Considerable, A Major, 5 Critical 

. ' *' ' ' ' ' 

10. InformatLOP is incomplete concerning the societal needs for vocational 

education. . 



OCCURRENCE: 1 Never, 2 Rarely, 3 Occasionally/^^^Fi^^uently ,,5^,Continu^lly 
SEVERITY: 1 Inconsequential', 2 Minor, 3 Considerable, 4 Major, 5 Critical 

11. Target populations are ^inadequately represented Jn the plarining 
process, .* <^ 

OCCURRENCE,* 1 Never, 2 Rarely, 3 Occasionally, 4 Frequently, 5 ContinuaLly 

Severity,: l inconsequential, 2 Minor, 3 Cansiderabie, ^ Major, 5 Critical 



k 



12. There is uncertainty at the state level about the purpose of state 
• . planning for vocational education. 



CURRENCE: 1 Never, 2 Rarely, 3 Occasionally, k Frequently, 5 Continually 
SEVERITY; 1 In'^onsequential, 2 Minor, 3 Ccnsiderablo, ^ Major, 5 Critical 
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13. The users of planning information are^rjpt clearly defined. 
OCCURRE^JCE: 1 Never. 2 Rarely, 3 Occasionally, 4 Frequsntly, 5 Continually 
SEVERITY: 1 Inconsequential, 2 Miaor, 3 Considerable, A Major, 5 Critical' 
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14. The level W aggregation of 'information necessary for particular 
users is noV clearly defined. * , ' 

OCCURRENCE: 1 Nd^er, 2 Rarely, 3 Oc^sionally, 4 Frequently, 5 Continually, 

SEVERITY: 1 Incbtisequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 

* 

15. The presently available data are inadequate for planning purposes. 
OCCURRENCE: 1 Never, 2 Rarely, 3 Occasionally, 4 Frequently, 5 cSn^nuaiSy 
SEVERITY:. 1 Inconsequential, 2 Minor, 3 Considerable,"^ 4 Major, 5 Critical 

16. The necessary data are too costly to collect. 

OCCURRENCE: 1 Never, 2 Rarely, 3 Occasionally, 4 Frequently, 5 Continually 
SEVERITY: 1 Inconsequential,' 2 Ilinor, 3 Considerable, 4 Maj-^ 5 Critical 

17. Data collected have different formats across collection agencies, 
OCCURRENCE: 1 Never^^ Rarely, 3 Occasionally, 4 Frequently, 5 Continually 
SEVERITY:'^ 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 

18* Available data are collected on inappropriate populations, 
OCCURRENCE: 1 Never, 2 Rarely, 3 Occasionally, 4 Frequently, 5 Continually 
SEVERITY: 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 

191 Collected data quickly become outdated, 

OCCURRENCE:^ 1 Never, 2 Rarely, 3 Occasionally, 4 Frequent ly, ' 5 Continually 

SEVERITY: 1 Inconsequential , 2 Minor, 3 Considerable, 4 Major, 5 Critical 
' * I 

20. There is restricted access to data sources. 

OCCURRENCE: 1 Never, 2 Ra^rely, 3 Occasionally, 4 Frequently, 5 Continually 
SEVERITY: 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 
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21. Available data do not exist at an approprlJLt: Ievi:L of aggregation, 

OCCURRifNCE,: 1 ^ever, 2 Rarely, 3 Occasional Ly . 4 Frequently, '5 Continually 

SEVERITY: ^ i >^cor.secuent ial, 2 Minor, 3 Ccnsi loraol'c , Major, 5 Critical • 
— ■ , ^ — , ^ _^ 

22. Reports ba'sed cn collected data'^^ipe not! updated with suffic^ient ' 
frequency, ^ , . ' - 

OCCCRRENCB^ 1 Never , 2. Rarely, 3 Occasionally, 4 Freauentlv, 5 Continually 

'SEVERITY: 1 Inconsequential', 2 Elinor, , 3^'Consid^^rable,, - Ma joe, 5 Critical^ 

23. Data about a»/a^'Lable 4 is^at* resources arr^. Incorroicte, <, . 

^.^i. \ - ' . * • ^ ^ 

OCCURRENCE; Nevirr, 2 Rarely,,;^ Occasionally, 4 F r^.quent ly 5 Continually 

SEVERITY. 1 LPConsaquential,. 2 Minor,, 3 Considerable., 4 Major, 5 Critical 
^ ^ ^ , 

24. The Iraplicattons of *data are *not cl^ar for .deci t i^OT-makipg purposes^ 

OCCURRENCE: I Never,. 2 Rarely, 3 Occasionally*/^ Frequencly, 5 Continually 

SE^feRlTY: 1 Inconsequential, 2 Mitior,* 3 Considerable, 4 Major, 5 Critical 
\ ; . / - ' 

234 Data atbout available physical resourced arc incomplete. , 

*V 5- , *' ' , " • 

OCCURE^ENCE ; , I Never, 2/ Rarely, 3 Occasionally, 4 Frequently, 5 Continually 
SEVERITY^ I Inconsequential, 2 ^linor, 3 Considerable', 4 5lajor, 5 Critical 

. . 5——^ . . ; — 1 ^— ^ ' ' — 

26. Da.ta about available human resources are incomplete. 

OCCURRENCE: 'i Never 2 Rarely, 3 Occasionally, 4 Frequent iy, 5 Continually 
SEVERITY:, 1 Inconsequential, 2 Minor, 3 Consid''ir?bit', 4 Major, 5 Critical 

27. Instruments are not available for the collection of needed data, 
OCCURRENCE: 1 Never, 2 Rarely, 3^ Occas ional ly, 4 Frequently, 5 Continaally 
SEVERITY: ^'l Incons.cqueftt ial I 2 Mipor, 3 Coneid'efa^lf, A Majoj:, 5-Cfitical 
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28. The form of data is inappropriate ior storage, retrieval » and 
dndtvsif^for roport'ing r^^quiremen^s . ,i ' 

(XX':URRE:NCE, l Never, 2 -Rarely, 3 Occasionally,:^ Frequently, 5 ^Gont inual ly 

S?:VERITYi Inconsequential, 2 Minor, 3 Coos iderable , 4 Major, 5 Critical 



29. -Th^ choice of level of data analysis is inappropriate, 

OCCURRENCE! 1 Never, 2 Rarely> 3 Occasionally, 4 Frequently, 5 Continually 

SEVF.RITY; 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major ,^ 5 .Critical 

30/ The choice of 'method of data analysis is inappropriate. 

OCCURRENCC^ 1 Never, 2 Rarely ; 3 Occasionally, 4 Frequently, 5 Continually 

SEVERITY: 1 Inconsequential, 2 Minerr, 3 Considerable, 4 Major, 5 Crit'ical 

3L. Theisk are inadequate numbers of personnel available to process and 
analyze the ^sired data, 

OCCDRRENCE. 1 Never, 2 Rarely, 3 Occasionally , 4, Frequent iy,' 5 Continually^ 
SEVERITY. 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 



32. ^ There are inadequately trained personnel available to process and 

analyze the desired data. 

OCCURRENCE; ] Ne^-er,- 2 Rarely, 3 Occasionally, 4 Frequently, 5 Continually 

SEVERITY 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical\^ 
- ^ < 

33, Thf^re are inadequate physical facilities to process and analyze the 
desired data, * 

OCCURRENCE. 1 Never,^ 2 R^^rely, 3 Occasionally , '4 Frequently, 5. Continually 
SEVERITY: i Inconsequential, 2 Minor, 3 Co^fl iderable, 4 Major, 5' Critical 



34. Resources allocated to state-level ptanning are insufficient. 
OCCURRENCE: 1 Newer, 2 Rarely, '3 Occasionally, 4 Frequently, 5 Continually 
SEVERIIV: 1 Inconiequential , 2 Minor. 3 Considerable, 4 Major, 5 Critical 



35. State- Icr«-f i staffs are not 'traiact^ l»T-oi Mi^.it^t tcch^-'iquv^s,/ , 
OCCUR§£NCI-:.. I \cVer»^ 2 ^ Rarely, 3 Occ\^ f quc^M I v , 5 Cantinuaily 

SEVERITY; ^1 In-^o.iseq^uenlrial , 2 Minor, 3 CLni^ij^-.i^b J: Maj'-<&» 5 Critical 



36. ' Lcccj]- le -j'l staffs are not trained *in ui^'nr inii' c ticni^iquf-?'-* 

OCCURRF.NVl. . :'New:ir, 2^ Rarely, 3 Occas iona , - Fr .qu.-nt l^- , 5^ Continually 

SEVERITY I Irconsequential, 2 Mifior, 3 Co^s i^cr 3C i o v 2^ Major, ^ Critical ' 



37. Pol it ioal constraints inhibit effCx^tive diit:a-hit-'<.a ^pl<=jn^«ipg, 

« 

OCCURRtNCF , i ^ovi^r, 2 Rarely, 3 Occa.-^icaal.i^ u Fr^.qurpt ly, ,5. Continually 

SEVERITY* 1 incop^oquenLiai , 2 Minor, 3 i . Major, «5 Critical . 
i_ ' J. 

38. Fiscal reso'jr:es that will be»availahic irt :hr fuLur^.to support 
program^ are uncertain or unspe^cif led . - • 3 * * ^ 

OCCURRENCE 1 ^^er, 2 Rarely, 3 OccasJlona i ly I Pt --q-jencl-y;; 5^^Continuall3§, ^ 

SEVERITY; I Inconsequential, 2 Minor, 3 CoK^V^rc^on:. * Ma j or /' 5* Critical ^ 

^ , - «< * 

39. Fiscal r^^.sources available to support lorg^*^3i\g/. orocrams are " 
insuf f iciei»£ , * • • ' ' 

OCCURRENCE. ^ ] N'evcr, 2j^arely, 3 Occasior-al iV^ ^ Fr^.qii'.^nt ly /5 Continually 

SEVERITY: 1 Inconsoquent ial , 2 Minor, 3 "or.^^i i d- r*an " Major, 5 Critical ''j 



40. Ailocat irr/'of funds is biased jby poHtical cons i dL>5at uens . ' 
OCCURRENCE. J Nc7*:r, 2 Rarely, 3 Cccasiora i i vt '-^ Tr- quertly;' 5 Continually 
SEVERITY. 1 Inconsequential, 2 Minor, Co«^. df roC Ic, Majorj' 5 CriticaJ. " 



41. There \h little assurance that funds ailQ'caJv^d lo the^ local sgho^ols 
: * will bf^, used according .to stste-lo^vel ' ip^C'irio-'S ^ , » ' 



OCCURRENCE: 1 Nf^vf^r, 2 Rarely, ,3 Occasioriallv. , 4,I;r::quein Iv, S Cont inuallj^, 
SEVERITY; 1 I nc onsfiquentral , 2 Minor, 3 U-p^-idtir^iM r . Major, 5 Qritical - 



42. There Ls not adequate mechanism for determining the number of 
educational professionals needed in the future, 

^OCCURRENCE. 1 Never, 2 Rarely, 3 Occasionally, 4 Frequently, 5 Continually 

SEVERITY; 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 

43 £ Ifeacher twining i^s^Xtutions are not sensitive to the needs of the 
C §ate fof trained ^§cs"onnel. 

OCeUR^NC^^ 1 Never, 2^^py, 3 Occasionally, 4 Frequently, 5 Continually 

SEVERITY: 1 Inconsequen^M, 2 Minor, 3 Considerable, 4 Major, 5 Critical 



44». l^service training ^^^s,tate department personnel is inadequate. 
OCC^JRP|NCE: 1 Never, 2;^jjy, 3 Occasional ly, 4 Frequent ly, ' 5 Continually 
SEViRilYr 1 Inconsecluen^^l 2 Minor, 3 Considerable, 4 Major, 5 Critical, 



45. Feedback on the "degr^^^ attainment .of product objectives is ^ 
inadequatie. ^ '-.^^ ^ 

- Mm ' ^ ' 

OCCpRR|ieE: 1 Never,..-2 ,Wel^;,- 3 OecasioHally, 4 Frequently, 5 Contiijual-ly 
SEVjSRIW: 1 Inconsequent ^gt;2 Minor, 3 Considerable, 4 Major, 5 Critical 



JjiSk^^ Feedback on the degr^^of attainment of process objectives is 
inadequate. • " * 



B- 1 Never, 2 ?^fiy^, 3 Occasionally, 4 Frequently, 5 Continually 
SEVERIT|: 1 Inconseqlienti^fj;2 Minor^ 3 Considerable, 4 Major, 5 Critical » 




^Accounting systejp^ to^ingnrtor expenditures by program categories 
" aror inadequate. ^'"^^'-^ ^ 



.occurrence' 1 Never, 2 Rar^J.^ 3 Oc^sionally, 4 Frequently, 5 Continually 
SEV^Ili: 1 Inconsequent i^g: 2 Minor, 3 Considerable, 4''Major, 5 Critical 




48. Systems to measure benefits of vocacio.nal educatior. programs are 
inadequate. • « - 

OCCURRENCE: 1 N^ver, 2 Rarely, 3 Occasioh^ally, ^ F^eqUennJby, 5 Continually 

SEVERITY; T Inconsequential , 2 Minor, '3 GDn^iderable, ^ ^fajpr, 5 Critical 

49. Student follow-up data are^ inadequa'te Ir/ - ' 

OCCURRENCE. 1 Never, 2 Rarely, 3 OccasionalIy^ 4 Frequt^tly, 5 Continually 

SEVERITY: J Incqnsequential , 2 Minor, 3 Considerable, 4 Major, 5 Critical 

( 

50. Uns'uccessf ul programs are difficult tq terminate, ^ 

• V 

OCCURRENCE: 1 Never ,o ^Rarely, 3 Occasionally, ^ Fi-equt^nt ly , 5 Continually 
SEVERITY-: 1 Incons?.quent ial , 2 Minor, 3 Considerabfe,' 4 Major, 5 Critical^ 



1. Criteria fot the selection of altematjLve pr&gram strategies ara 
not specif ied* ' ' * ,^ 

OCCURENCE:: "^1 Never, 2 Rarely, 3 Occasionally, 4 Frequently, 5 Continually 

SEVERITY: 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 



52. Policies are inadequate on how inf ormat'ion will be used in decision- 
'makiTig. " * ^ • 

OCCURRENCE:' 1 Never, 2 Rarely, 3 Occasionally, 4' Frequently , 5 Continually 

SEVERITY: ,1 Inconsequential^ 2 Minpr, 3 Cuusiderable, 4 Major, 5 Critical 



53/ Local facilities are inadequate for program requirements, 

OCCURRENCE: 1 Never, 2 Rarely, 3 Occasionally, 4 Frequently, 5 Continually 

SEVERITY: 1 Inconsequential, 2 Minor, 3 Considerable, 4 Major, 5 Critical 

54. Procedures for the estimation of future employment demands are J 

inadequate. . . * • . 

* ^ ^ * ♦ , . " 

OCCURPilNCE: 1 Never, '2 Rarely, 3 Occasionally, 4 Fxequently, 5 Continually 
SEVERITY: 1 Inconsequential > 2 Minor, 3 Considerable, 4 Major, 5 Critical 



55. There is insufficient control over the placemen^t process. 
^CURRENCE: *lr Neyer, ^-Z Rareljr, 3 Occas^ionally, 4 Frequently, 5 Continually 
SEVERITY: 1 Inconsequential, 2 Minor/'3 Considerable, 4< Major, 5 Critical 

56. Coordination o^ general and vocational education/is inadequate* 
OCCURRENgE; 1 Never, 2 Rarely, 3 Occasionally, 4 frequently, 5 Continually 
SEVERITY: 1 Inconsequential, 2 Minor^ 3 Considerable, 4 Major, ^ 5 Critical* 



Section *3 

From the previous pages, indicate the number of the, stacemerits which iden- 
tify the mo'st ^ign^if i^ant planning problems in ybur state, '^''^ 



american vocational association inc headquarters office washinston d c 

' . January 16,, 1973 



TO: ^ State ^Director's' 



Lo'^^el 1 Burke^t^ Execu-t.i^'e' Director 



The American Vocational ^Association is sponsoring a series of conferences 
^ on state planning ^ fo,r \/t2X:atidn<il ' education to 'be held /here^ in Washington,. D. C, 
durin^^ Januar> and F-:bjcuary. The ;irttent of €he conference series is to develop 
a .->ec of guide Lines which" may be used by stat>^ directors of vocational educa- 
tic.fi :n the preparar i on of theii! staie plans. Three groups of nationally known 
state directors, educators ,^ economists and planning specialists are being 
gathered to construct these guidelines as service from the American Vocational 
.\ssociation to the field. 'The Center for Occupk:^t ional Education, .located at 
North Carolina State University, through its Divl^sion «^f^^Dynamic Analysis and 
Strategic Plarning (DASP)/is cooperating with- the AVA-'ln the. conduct of the con- 
ference and has provided the funding, ^^aff f roiu: the £^nter.will provide assis--- 
"tarce in the aaaly-^is of data and the final pirod^fctioh- of* the guidelines, as 
ueil^ss partieipating in the conference itself. , * - ."'^ ^ ^ 

\n oraer >to provide our can/*-rence participants with as clear, a picture 
as possible of the problems which now exist in the planning process in the 
states, we ha^^e developed a brief qu^estionnaire which attempts to co^^V* some of 
the^ utost ncta'ble problems , facing planners, in the states. I would appreciate- it 
«^erv nuch if you could take a bit of • your -.timc^ to complete this questionnaire 
and return^it, in tue enclosed envelope, to t"fie Cent ej> fo if* Occupational Education 
f-jr analysis/ "hvery effort is being .made tcr make^the responses compl^t^ly anony- 
Tous, -so%we wi 11 be unable to send iadividua:!. r^miml^rs to each of you.. Ther.e- 
rore, I ».rgen,tly rfiquest th.at ypu find a little jsrT^our time, or ^s5ign someone 
finiliar with the olanning prbblefns in youi;^ gtat/e, .to ^compl-ete thi^S que^trionnaire . 
J sincerely believe that it will be^ in the 1)est: intere/ts ot the sta^t^V'j.f .this 
inf orrration-.can be made available, to our participants. - ^ ' ' 

: - Bec^'use Ti4nds for these- conferences have only -recently become available, 
there i.- v^r-l'itt Je cirae before our first 'conference. ' Conseq^uent ly , I'am 
a?kirg not i ..tbai'^ youvTomplete our q.u^stionnai re^ b*ut also ^that, it be returned 
in the snorl-st: possible timp. I am well aware that for mosti of you this is a 
r.articuiar ly demanding, tim^.^n a i!|suaijy demanding" job . ' However, if we can 
^Str--^ i^ Ls inf?)*rma- ion .in time< for its us'e by our conference participants, we 'can 
^Ij^.v i-^si/r^ tne kind c^f quality product which may'make your job of state planning 
a Uttlp. easier * The guidelines should -b^j available for release by mid-spring 
ar^^;' i make arr-^.p-emenrs to have copies .shipped to each o f you as" soon as 

'you f :>r y^ur coop\:rati oa . ' , * 




loweir a burkett^ 
executive director 



